Situation Awareness As a Predictor of Performance in En Route Air Traffic Controllers

In this study, air traffic control instructors controlled simulated traffic while three techniques for determining situation awareness (SA) were implemented. SA was assessed using a self-report measure (SART); a query method that removed information on the plan-view display (SAGAT); a query technique that did not have a memory component (SPAM); and the detection of errors integrated into the scenarios (implicit performance). We used these measures of SA together with a measure of workload, NASA TLX, to predict two different performance measures. One performance measure was an over-the-shoulder, subjective assessment by a subject matter expert (SME). The other performance measure was a count of the number of control actions remaining to be performed at the end of the scenario. The SME evaluation was predicted by workload and the controller's appreciation of both the present and the future. The remaining-actions count (RAC) was predicted by the controller's appreciation of the future. In fact, an appreciation of the present led to poorer RAC scores: The better the participant was at answering questions about the present or the better he or she understood the present situation, the larger the number of actions remained to be performed. The results have implications for the relationships among workload, situation awareness, and performance, and suggest limitations on several of the measures currendy proposed as SA techniques. The results confirm that future versus present is an important conceptual difference in air traffic control. More importandy, the results suggest that a controller who remains overly focused on the present may do so at the expense of the future.